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ABSTRACT 

INTRODUCTION Use of the Consolidated Standards of Reporting Trials (CONSORT) statement has been shown to improve the 
reporting of randomised controlled trials and it is endorsed by leading surgical journals. The CONSORT statement for non-phar- 
macological treatment (C0NS0RT-NPT) provides specific items to aid in the reporting of trials of operative intervention. This 
study compares the reporting practice of trials of operative intervention published in time periods before and after publication 
of the CONSORT-NPT statement. 

METHODS A 30-point checklist containing the salient CONSORT-NPT items was designed and the adherence of trials meeting 
the inclusion criteria determined independently by two authors. 

RESULTS There was a significant improvement of 3.95 points in the mean CONSORT-NPT score from 2004 to 2010 (95% 
confidence interval: 3.61-4.29, p<0.001). This related specifically to items present in the original CONSORT statement rather 
than to CONSORT-NPT items, which remained poorly reported in 2010. The mean CONSORT-NPT score was 17.5 (standard 
deviation [SD]: 4.5) for trials published in CONSORT endorsing journals compared with 15.6 (SD: 4.0) for those that did not 
mention endorsement of the CONSORT statement although this was not a significant difference (p=0.064). 
CONCLUSIONS Although there has been a significant improvement in the reporting of trials of operative intervention published 
in the surgical literature since 2004, items specific to the CONSORT-NPT extension remain underreported. Improved aware- 
ness of this important addition to the CONSORT statement throughout the surgical community and its endorsement by surgical 
journals will help to improve the reporting practice of trials of operative intervention. 



KEYWORDS 

CONSORT - Randomised controlled trial - Publishing/standards - Research design 
Accepted 25 March 2012 
CORRESPONDENCE TO 

Alex Gordon-Weeks, RRI Building, Gray Institute for Radiation Oncology and Biology, Churchill Hospital, Old Road, Headington, Oxford 
0X3 7LE, UK 

T: +44 (0)7808 030 432; E: alex.gordonweeks@gmail.com 



The randomised controlled trial (RCT) represents the gold 
standard method for determining an association between 
treatment and outcome. 1 As important as the quality of the 
trial is the quality of its reporting; without transparent re- 
porting, adequate appraisal of a trial's methodological qual- 
ity and external validity is not possible. The Consolidated 
Standards of Reporting Trials (CONSORT) statement pro- 
vides a minimum set of recommendations for the reporting 
of RCTs and is endorsed by many peer reviewed journals. 2 
Its endorsement is widely recognised to have improved the 
reporting quality of RCTs. 3 However, since its introduction 
and update in 2001,' numerous articles have identified on- 
going reporting quality deficiencies in both the medical 5 ' 3-7 
and surgical 8-10 literature. 
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Trials of operative intervention carry inherent meth- 
odological challenges 11 and so the CONSORT statement in 
this setting is not as useful as for trials of pharmacological 
intervention. Such challenges include accounting for varia- 
tion in the recruiting and consenting practices of surgeons, 
difficulty in blinding patients and outcome assessors, the 
presence of confounding factors such as the surgeon's tech- 
nical ability, differing anaesthetic technique and the need 
to standardise operative technique between surgeons who 
have different training backgrounds. As a result, the empha- 
sis of reporting is different than for trials of pharmacological 
intervention. The reporting of certain methodological fea- 
tures gains increased importance while other features are 
entirely unique to surgical trials. 
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The CONSORT statement for non-pharmacological 
treatment (CONSORT-NPT) provides criteria specific for 
such features, enabling assessment of the reporting quality 
of trials of operative (and other non-pharmacological) in- 
tervention while maintaining important reporting elements 
of the original CONSORT statement. 12 Such items specific 
to the CONSORT-NPT checklist include the way in which 
interventions are standardised between surgeons, the as- 
sessment of a surgeon's adherence to such standardisation, 
the volume of participants treated per surgeon and the sur- 
geon's experience with the intervention. 

To date there has been no published analysis of the ad- 
herence of trials of operative intervention to the CONSORT- 
NPT statement or assessment of whether the CONSORT- 
NPT extension has led to an improvement in the reporting 
quality of such trials. This study analyses the adherence of 
trials of operative intervention to the CONSORT-NPT state- 
ment at time periods before and after its publication in or- 
der to determine whether the CONSORT-NPT extension has 
contributed to an improvement in the reporting standard of 
trials of operative intervention. 

Methods 
Search strategy 

Electronic searches of MEDLINE® and Embase™ were per- 
formed by a librarian at the John Radcliffe Hospital, Oxford. 
The following journals were searched: British Journal of 
Surgery, Archives of Surgery, European Journal of Cardio- 
Thoracic Surgery, European Urology and Journal of Bone 
and Joint Surgery (Rritish volume). These publications were 
chosen to represent high impact factor journals providing 
information from a range of surgical specialties. The Annals 
of Surgery was excluded as a preliminary search revealed 
that it had published relatively few RCTs for the time periods 
studied. All included journals (with the exception of the Eu- 
ropean Journal of Cardio-Thoracie Surgery) have endorsed 
the CONSORT statement in their instructions to authors 
since 2007. No journal had mentioned the CONSORT-NPT 
statement as of February 2012 and the European Journal of 
Cardio-Thoracic Surgery had not mentioned the CONSORT 
or CONSORT-NPT statements. 





1. MEDLINE;"archives of surgery*". in;14105 results. 

2. MEDLINE;exp RANDOMIZED CONTROLLED TRIAL/;301087 results. 

3. MEDLINE;randomi*.ti,ab;282307 results. 

4. MEDLINE;2 OR 3;416669 results. 

5. MEDLINE;1 AND 4;510 results. 

6. MEDLINE;5[Limit to: Publication Year 2004-2004]; 18 results. 

7. EMBASE;"archives of surgery*".jn; 13056 results. 

8. EMBASE;exp RANDOMIZED CONTROLLED TRIAL/;289969 results. 

9. EMBASE;randomi*.ti,ab;349135 results. 

10. EMBASE;8 OR 9;459951 results. 

11. EMBASE7 AND 10; 482 results. 

12. EMBASE; 11 [Limit to: Publication Year 2004-2004];23 results. 

13. MEDLINE, EMBASE; Duplicate filtered: [5[Limitto: Publication Year 
2004-2004]]. [1 1 [Limit to:Publication Year 2004-2004]];41 results. 


Figure 1 Search strategy for identification of randomised trials 
of operative intervention 



The search was limited to two time periods: January to 
December 2004 (sufficiently long enough following the 2001 
CONSORT statement revision 1 that trialists should be aware 
of its publication) and January to December 2010 (simi- 
larly with regard to the publication of the CONSORT-NPT 
statement in 2008). 12 The search history for an example 
journal can be seen in Figure 1. The search was repeated for 
each journal at each time point to ensure that all published 
RCTs within the search limits were retrieved. The NHS Evi- 
dence advanced search software (http://www.library.nhs. 
uk/) was used to perform electronic searches. 

Inclusion/exclusion criteria 

RCTs were included if they reported the comparison of at 
least one non-pharmacological intervention. This included 
trials of surgical technique, surgical access, technology 
and instrument design as well as anaesthetic interventions. 
RCTs comparing solely pharmacological interventions were 
excluded. All journals included in this study publish their 
manuscripts in English. 

Studies were included in chronological order until a 
sample size of ten trials per journal per time point had been 
reached. This limit was set based on labour constraints 
rather than performing a sample size calculation, which, 
following personal communication with the study's lead 
statistician (DA), was felt to be unnecessary given that a de- 
fined hypothesis was not being tested. 

Publications of retrospective, observational, experimen- 
tal and animal studies were excluded as were trials report- 
ing follow-up data of a previously published trial. Journals 
that endorse the CONSORT statement were defined as those 
that reference the statement in their instructions to au- 
thors or those journals that are referenced on the relevant 
CONSORT webpage (http://www.consort-statement.org/ 
about-consort/consort-endorsement/consort-endorsers— 
journals/). Journals were not excluded on the basis of their 
lack of endorsement of the CONSORT statement. 

All abstracts retrieved from database searching were re- 
viewed for selection by two authors (AGW and RG). Studies 
in which it was not clear whether the inclusion criteria had 
been met were reviewed in full text and discrepancies be- 
tween the two authors were resolved by discussion with the 
remaining authors. 

Data extraction 

All publications were reviewed in full text by two authors 
(AGW and RG). From the CONSORT-NPT statement, a 
50-point scoring system was devised (Table 1) giving equal 
weighting to CONSORT-NPT items and resulting in a score 
out of 30 for each trial. Two further items not included in 
the CONSORT-NPT statement (method of anaesthesia and 
sources of funding) were added as it was felt that these fac- 
tors could be significant confounders in the design of trials 
of operative intervention such that their reporting was key. 
The reporting of the effect of clustering on sample size cal- 
culation and the estimate of the effect size and its precision 
were allocated their own point on the scoring system. 

Reporting of intention to treat was not included as an 
item in the scoring system as previous studies have pro- 
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Table 1 The 30-point scoring system developed from the CONSORT-NPT and used to assess publications meeting the inclusion 
criteria 


Paper section 


CONSORT-NPT item 


Description 


Introduction 


Background 


Introduction and scientific background. Explanation of rationale for study, objectives and 
hypotheses 


Methods 


Eligibility (participants) 


Participant eligibility criteria outlined clearly 




Eligibility (centres/surgeons)* 


Outlining the eligibility criteria for centres involved in the trial (multicentre) and of those 
surgeons participating in the trial 




Study setting 


Setting in which the intervention is administered stated clearly 




Intervention/control 


Details of the operative intervention and control such that they could be performed by the 
reader, any changes required to the intervention or control for specific patients 




Intervention standardisation* 


How operative techniques were standardised between participating surgeons 




Surgeons' adherence* 


Details of how operating surgeons' adherence to standardised interventions or protocols 
was monitored 




Anaesthetic** 


Type of anaesthesia used and the number of participants receiving different anaesthetic 
methods 




Outcome measures 


Clearly defined primary and secondary outcome measures 




Sample size 


Explanation of how sample size was determined 




Clustering (surgeons/centres)* 


Explanation of how the effects of clustering in care providers was addressed 




Randomisation: sequence 
generation 


Method used to generate the random allocation sequence 




Randomisation: allocation 
concealment 


Method used to implement the allocation sequence (sealed envelopes, telephone etc) 




Implementation 


Description of who generated the random sequence and assigned participants to their 
groups 




Degree of blinding 


Description of whether participants, surgeons and/or outcome assessors were blinded 




Blinding method* 


Description of the methods used to blind participants, surgeons or outcome assessors 




Statistical methods 


Statistical methods used to compare groups for outcomes 


Results 


Participant flow 


Flow of participants through each stage (diagram recommended but not a necessity) in- 
cluding the numbers of participants randomised, receiving each intervention, completing 
the study and analysed for each outcome 




Participant volume per 
centre/surgeon* 


Documentation of the number of participants treated by each surgeon/centre 




Recruitment and follow-up 
dates 


Dates during which participant recruitment was undertaken and when follow-up was 
arranged 




Demographics 


Summary of baseline demographic data and clinical characteristics 




Experience* 


Description of the centre or surgeon's experience with the technique including data on 
previous case volume, qualifications and expertise 




Analysis 


Documentation of the numbers used in analysis (absolute numbers) 




Documentation of outcomes 


Documentation of the findings for both the primary and secondary outcomes 




Effect size and precision 


Documentation of estimated effect size and its precision (95% confidence intervals) 




Adverse events 


Documentation of adverse events in the study group 


Discussion 


Interpretation 


Interpretation of results including discussion regarding sources of bias, imprecision and 
shortcomings. If indicated, discussion of lack of blinding, unequal expertise of surgeons 
etc. 




General isabi lity 


Discussion regarding the external validity or otherwise of the study (in particular, the 
experience of the surgeons, type of centre and participant selection) 




Evidence 


Discussion of the study results in the context of current evidence and opinion 


Additional 


Funding** 


Description of sources of funding 



*items with features specific to the CONSORT-NPT statement 
"items added by the authors for the purpose of this study 
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vided evidence to suggest that this method of analysis is 
frequently misreported by trialists. 13 Any addition or retrac- 
tion of items from the original CONSORT-NPT checklist was 
done following discussion with all listed authors including 
a senior member of the CONSORT Group (DA). It has been 
noted that the CONSORT Group does not recommend the 
use of the checklist to provide a quality 'score'. 14 However, 
this approach gives a useful summary of overall reporting 
standard when comparing time periods to complement 
comparison of the reporting of specific items. 

The data extracted by each author were compared and 
any discrepancies resolved with discussion between the au- 
thors and re-review of the publication. Any remaining dis- 
crepancies were discussed with a third author (MS) until 
a consensus had been reached and a final score obtained. 
Assessors were not blinded to the time period or journal in 
which the RCT was published. 

Outcome measures 

The primary outcome measure was the difference in mean 
total modified CONSORT-NPT statement score between 
the 2004 and 2010 time periods. The secondary outcome 
measures were both percentage of adherence to each CON- 
SORT-NPT item and the difference in mean total modified 
CONSORT-NPT statement score between those journals en- 
dorsing the CONSORT-NPT statement and those not doing so. 

Statistical analysis 

Normally distributed means were compared using Student's 
t-test and non-normally distributed data with the Mann- 
Whitney U test. Normality was determined by visualisation 
of histograms and p-values of <0.05 were considered statisti- 
cally significant. 

Results 

Study flow, demographics and CONSORT-NPT endorse- 
ment 

The study flow can be seen in Figure 2. A total of 191 RCTs 
were identified with 81 and 110 published in 2004 and 
2010 respectively. Of these, 55 publications were excluded 
because the maximum number of RCTs had already been 
reviewed for specific journals within specific time points. 
The demographic details for publications at each time point 
were similar (Table 2). 



Table 2 Demographics of included studies 







Publication year 






2004 


2010 


Number of trials 


44 


40 


Participants 




7,082 

(DO /o) 


5,187 (42%) 


Location 


Europe 


3U (bo /o) 


Zo ( /U /o) 




North America 


C f 1 A Of \ 

b (14/o) 


c / 1 Q 0/ \ 
3 (13 /o) 




Asia 


a mo/ \ 
4 (y /o) 


D (13 fo) 




Oceania 


3 (/ /o) 


tL (D /o) 




Africa 


1 (2%) 


0 (0%) 




South America 


0 (0%) 


0 (0%) 


Specialty 


Cardiothoracics 


9 (20%) 


10 (25%) 




Orthopaedics 


10 (23%) 


8 (20%) 




Urology 


5 (11%) 


8 (20%) 




General surgery 


20 (45%) 


14 (35%) 


Organisation 


Single centre 


34 (77%) 


31 (78%) 




Multi centre 


10 (23%) 


9 (23%) 


Design 


Parallel 


36 (82%) 


36 (90%) 




Multiple arms 


8 (18%) 


4 (10%) 




Intervention 


41 (93%) 


39 (98%) 




Diagnostic 


3 (7%) 


1 (3%) 


Journal 


Endorses 
CONSORT 


35 (80%) 


30 (75%) 



] 



Total articles identified by literature search 

191 



Excluded {10 RCTs 
already met inclusion 
criteria within timeframe) 








Total RCTs analysed 
84 



Failed to meet inclusion/exclusion criteria 
19 (non-operative intervention) 
14 (follow-up RCTs) 
14 (not RCTs) 
5 (experimental studies) 



Figure 2 Flowchart of study showing included and excluded 
randomised controlled trials (RCTs) 



Comparison of mean CONSORT-NPT score 

The mean CONSORT-NPT score was 15.2 (standard devia- 
tion [SD]: 3.8) for RCTs published in 2004 and 19.1 (SD: 4.1) 
for those published in 2010. The improvement in mean 
CONSORT-NPT score from 2004 to 2010 was 3.95 points 
(95% confidence interval: 3.61-4.29, p<0.001). There was 
considerable variation in the reporting of individual CON- 
SORT-NPT items with several items being underreported at 
both time points (Table 3). No single trial scored 100%. 

Adherence to the CONSORT-NPT statement 

Regarding methodological issues, for RCTs published in 
2010 there was a significant increase in the reporting of sur- 



geon's/centre's eligibility criteria, sample size calculation, 
method for random sequence generation and allocation 
concealment (Table 3). For the results section, a significant- 
ly higher percentage of RCTs published in 2010 included a 
flow diagram or at least sufficient information to determine 
participant flow. There was also a significant improvement 
in the reporting of the number of participants treated per 
surgeon or centre, the study population's demographics and 
the experience of the surgeon or centre with the interven- 
tion technique. Finally, a significantly higher percentage of 
studies published in 2010 highlighted potential areas of bias. 



Ann R Coll Surg Engl 2012; 94: 388-394 



391 



2269 Gordon-Weeks.indd 391 



15/08/2012 14:28:19 



GRAY SULLIVAN ALTMAN GORDON-WEEKS 



ADHERENCE OF TRIALS OF OPERATIVE INTERVENTION TO THE 
CONSORT STATEMENT EXTENSION FOR NON-PHARMACOLOGICAL 
TREATMENTS: A COMPARATIVE BEFORE AND AFTER STUDY 



Table 3 The number of trials that reported each CONSORT-NPT item for articles published in 2004 and 2010 



I d|Jc[ bcLLIUM 


rONKORT-NPT itpm 

LUINOUu 1 - IN r 1 1 LCI 1 1 


TYi ale fpnnrtino item 
llldlb fcpuiLlllg ILclll 

9004 


901 0 


fj Vd lUc 


1 f 1 LlOUUCLIUl 1 


DdLKgiUUMU 


Q o f7Qo/\ 
Oil l/o /oj 


9Q (71°/ \ 
\ / o /o j 


i n 
1 .u 


1 VI cLl lUUb 


LllglUIIILy Vpdi LIL 1 pdl 1 Laj 


^.9 / 7 1 °/ 'I 
o^ \. / o /oj 


jD /oj 


O OAR 




ciigiuiiiLy ^CcNLicb/burgcONbj 


A (Q°/ ^ 
*f \y /o) 


11 (07°/ \ 
11 VZ / /oj 


O H9Q 




oLUUy bcLLnlg 


i / \oy /oj 


IDO /oj 


U.UOD 




1 II Lclvcf 1 LIOl l/CON LI (Jl 


An fQi °/ ^ 

H U I, z/ 1 /o j 


JO ^ O /o j 


n A7 




1 II Lcl VcM LIUl 1 bLdNUdlU ISd UUf 1 


1 o I, 1 /o j 


1 7 CA^°/ ^ 
1 / /o j 


n rr 




oUigcOllb dUl lclcl lCc 


9 ( R°/ ^ 


o /oj 


n R7 




rtlldcbLI lcLIL 


1 / iJ3 /Oj 


1 D yt+KJ /o j 


n q 




VJULLUINc IllcdbUrcb 




J^. VoU /o j 


n r^ 

U.OO 




Odffipic blZc 


9fl i 
^.U 3 /oj 


QO /Rn 0 / ^ 

jZ IOU /o j 


sU.UU 1 




L-IUbLcilllg ^bUigcONb/CcNLicbj 


n f n°/ ^ 

U \U /oj 


1 \3 /oj 


fl 9Q 




rVdllUUI lllbaLIUli: bcLjUcllCc gcllcidUUll 


OQ /COO/ \ 
/oj 


9R (7n°/ 1 
Z o ^ / U /o j 


n n^A 




rxdnuuiiiibdiiun: diiuLduuri LuriLcdiiitciiL 


9 1 fAR 0 / \ 

£l \H-0/oj 


9Q (73°/ ^ 






1 1 1 1 picl Ncl 1 Ld LION 


11 V ^- o /o j 


91 ( i=; ^ °/ ^ 

Ijj /o j 


U.U1U 




Ucglcc Ul UllllUlllg 


on (AR°/ i 
ZU ^0 /oj 


91 f - R ^ °/ ^ 


n R9 




D 1 1 lIU 1 fig 11 lc 1 1 l(J(J 


1j V^fO /oj 


1 Q (AR 0 / 1 
iy ^h-o /oj 


U. O Z7 




OldLlbLILdl lllcLIIUUb 


A9 CQR°/ ^ 


ah ^ i nn°/ ^ 

V 1 UU /o j 


n ^a 


P QC | 1 Ifc 

r\cbU 1 Lb 


rdi LIL 1 pdl 1 L 1 IUW 


1Q 0/\ 
1 o 1 /o j 


QO fRfW 1 
iOU /oj 


sU.UU 1 




Participant volume per centre/surgeon* 


y ^zu /oj 


1 / /oj 


U.U34 




Recruitment and follow-up dates 


38 (86%) 


39 (98%) 


0.067 




Demographics 


36 (82%) 


40 (100%) 


0.003 




Experience* 


5 (11%) 


15 (38%) 


0.005 




Analysis 


42 (95%) 


39 (98%) 


0.62 




Documentation of outcomes 


42 (95%) 


36 (90%) 


0.34 




Effect size and precision 


9 (20%) 


14 (35%) 


0.14 




Adverse events 


35 (80%) 


35 (88%) 


0.33 


Discussion 


Interpretation 


15 (34%) 


28 (70%) 


0.003 




Generalisability 


12 (27%) 


18 (45%) 


0.2 




Evidence 


37 (84%) 


38 (95%) 


0.19 


Additional 


Funding** 


20 (45%) 


28 (70%) 


0.012 



*items with features specific to the CONSORT-NPT statement 
**items added by the authors for the purpose of this study 



Methodological items reported by <50% of RCTs in 
2010 include the eligibility criteria on which surgeons or 
centres were selected (27%), the type of anaesthesia used 
(40%), how interventions were standardised between 
surgeons (43%), the methods used to monitor surgeons' 
adherence to the intervention or comparator techniques 
(8%), the effect that clustering has on the sample size cal- 
culation (3%) and the method of blinding participants or 
outcome assessors (48%). For the reporting of results, the 
number of participants treated by each surgeon or centre 
(43%), the surgeon's/centre's experience (38%) and the 



confidence of the effect estimate (33%) were all poorly re- 
ported (Fig 3). 

CONSORT-NPT score and journal practice 

The mean CONSORT-NPT score (both time points) for those 
studies published in CONSORT endorsing journals (mean: 
17.5, SD: 4.5) was higher than that for the European Journal 
of Cardio-Thoracic Surgery (mean: 15.6, SD: 4.0). However, 
this did not reach statistical significance (p=0.064). When 
this was analysed per time period there was also no signifi- 
cant difference. 
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Baseline demographics 
Statistical methods 
Number analysed 
Recruitment and follow-up dates 
Reference to current evidence 
Intervention/control 
Primary/secondary outcomes 
Eligibility (participants) 
Adverse effects 
Sample size calculation 
Defined outcome measures 
Participant flow 
Background 

Randomisation: allocation concealment 
Sources of funding 
Randomisation: sequence generation 
Consideration of bias 
Study setting 
Who was blinded? 
Who allocated patients to groups? 

How were they blinded? 
External validity 
Intervention standardisation 
Participant volume per surgeon/centre 
Anaesthetic 
Centres'/surgeons'experience 
Effect size and precision (95% CI) 
Eligibility (centres/surgeons) 
Assessment of surgeons' adherence 
Effects of clustering (surgeons/centres) 



• specific to CONSORT-NPT statement 

• also in original CONSORT statement 

CI = confidence interval 



50 

Percent reported 



100 



Figure 3 Percentage of adherence to the CONSORT-NPT 
statement for trials published in 2010 



Discussion 

Trials involving operative rather than pharmacological in- 
tervention bring inherent methodological challenges. Fail- 
ure to overcome such challenges in the conduct of a trial is 
likely to lead to considerable bias, potentially invalidating 
the results and limiting their interpretation. Adherence to 
the CONSORT statement enables trial authors to maintain 
a transparent system of reporting so that the reader can 
draw considered conclusions from the trial findings. Previ- 
ous studies have found that trials published in the surgical 
literature are lacking in their adherence to the CONSORT 
statement. 8 " 10 

Balasubramanian et al found that trials published in 
high impact surgical journals reported only 69% of CON- 
SORT items. 9 Similarly, studies analysing the reporting qual- 
ity of publications in spinal 15 and cardiothoracic 16 surgery 
found on average 65% and 66% of CONSORT items were 
reported respectively while the figure for urological trials 
was lower still at 52%. 8 

Afl such studies acknowledge the difficulties in per- 
forming surgical trials. However, all determined CONSORT 
statement adherence rather than CONSORT-NPT adherence 
and included trials of pharmacological as well as opera- 
tive intervention in their assessment. This makes them less 
specific for the analysis of operative trials and the reporting 
of methodological features, which make such trial design 
difficult. Furthermore, no previous study has analysed re- 
porting adequacy in trials of operative intervention at two 
time points such that until this time any change in reporting 
standards could not be quantified. 

It is recognised that in conducting this study the analysis 
is limited to four surgical specialties and that although data 



extraction was not performed in a blinded fashion, consen- 
sus was reached between multiple authors when scoring tri- 
als. The high quality of the search strategy and well defined 
inclusion/exclusion criteria enabled the analysis solely of 
trials of surgical intervention at two time points separated 
by the introduction of the CONSORT-NPT statement. 

Equal weighting was given to all items in the CONSORT- 
NPT statement to create an overall score although some 
items may in fact assume greater importance than others. 
Nevertheless, presentation of the figures for the reporting 
of each item individually (Table 2) enables a clearer under- 
standing of the items most frequently underreported. Final- 
ly, although the demographics of the included trials differed 
little between the two time periods studied (Table 2), it is 
recognised that improvements seen in the CONSORT-NPT 
score in the period studied could result from secular trends, 
in particular an improved awareness of an evidence-based 
approach in the surgical community or stricter ethical reg- 
ulations imposed on trials rather than publication of the 
CONSORT-NPT statement alone. 

Importantly, the significant improvement in reporting 
from 2004 to 2010 resulted from improved reporting of items 
such as sample size calculation, allocation concealment and 
participant flow (all items found in the original CONSORT 
statement). Comparison with prior estimates of reporting 
practice supports this improvement. For example, previous 
estimates for the number of trials in the surgical literature 
reporting sample size calculations were 20% (2003) 16 and 
44% (2008) 15 compared with 80% (2010) here. Similarly, the 
percentage of trials reporting study flow was estimated at 
51% (2000-2003) 8 and 52% (2008), 15 and documented as 
80% (2010) here. This trend is repeated for reporting of par- 
ticipant blinding, random sequence generation and alloca- 
tion concealment among other items. 

Conclusions 

Although CONSORT items unproved significantly, there was 
little improvement in CONSORT-NPT specific items, all of 
which were reported in less than 50% of trials in 2010 (Fig 3). 
While journals give specific instructions to authors regard- 
ing the use of the CONSORT statement, no mention of the 
CONSORT-NPT statement was found in the journals included 
in this study. Peer reviewed journals' instructions to authors 
are likely to have played a large part in improving the aware- 
ness of reporting standards throughout surgical academia 
by insisting on adherence to the CONSORT guidance. The 
evidence presented here strongly suggests that journals pub- 
lishing trials of operative intervention should pay equal at- 
tention to the CONSORT-NPT statement with the aim being 
to improve both authors' and reviewers' awareness of this 
CONSORT extension. This will, in turn, help to improve the 
quality of reporting of methodological issues specific to such 
trials, enabling clearer interpretation of their outcomes. 
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